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(57) Abstract 

This invention is tracking a motion of a body by obtaining two types of measurements associated with the motion of the body, one 
of the types including acoustic measurement. An estimate of either an orientation or a position of the body is updated based on one of 
the two types of measurements, for example based on inertial measurement obtained by an inertial measurement unit (140). The estimate 
is then updated based on the other of the two types of measurements, for example based on acoustic ranging obtained by ultrasonic range 
measurement units (1 10). The invention also features determining range measurements to selected reference devices that are fixed in the 
environment of the body, for example ultrasonic beacons (122) fixed in ultrasonic beacon array (120). 
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MOTTON TRACKING SYSTEM 
Background 

The invention relates to motion tracking. 

Motion tracking can use a variety of measurement 
modes, including inertial and acoustic measurement modes, 
to determine the location and orientation of a body. 

Inertial motion tracking is based on measuring 
linear acceleration and angular velocity about a set of 
typically orthogonal axes. In one approach, multiple 
spinning gyroscopes generate forces proportional to the 
rates at which their spinning axes rotate in response to 
rotation of a tracked body to which the gyroscopes are 
attached. These forces are measured and used to estimate 
angular velocity of the body. Micro-machined vibrating 
elements and optical waveguide based devices may be used 
in place of gyroscopes. 

Acceleromet.ers generate, signals proportional to . 

forces which result from linear .acceleration. In an 
inertial tracking system, the. { angujar velocity . ^nd . „ 
acceleration signals are integrated to determine linear 
velocity, linear displacement, and t.ot;al angles of 
rotation. 

■ As the signals generated by gyroscopic devices are 
noisy, the integration process results in accumulation- of 
noise components , which- is generally known as "drift".-.. 
Miniaturized and low cost gyroscopic devices typically., 
exhibit greater error. Drift rates can be as high as ■ 
several degrees per second for a" body at rest, and 
several degrees for every rotation of the body by 90 
degrees. Errors in orientation estimates also affect 
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location estimation as the estimated orientation of the 
body :is :.used to transform acceleration, measurements into 
the" fixed reference frame of the environment prior to 
their integration. Inaccuracy in this transformation can 
result in -gravity appearing- as a .bias a resulting 
horizontal * acceleration measurements. 

One. way to correct drift is -tp use additional 
sensors / . such as inclinometers : and. a compass to . 
occasionally or continually correct the drift of the 
integrated inertial measurements. For instance, U.S. 
Patent 5,645,077, issued to Eric M. Foxlin on July 8, 
1997.., discloses such an approach.. This patent in 
incorporated herein by reference. .... 

Another- approach to motion tracking uses 
acoustic waves to measure distance between one or more 
points on a body . and- fixed reference points in the . 
environment. In. one arrangement, , termed an "outside -in" 
arrangement, a set = of. acoustic, emitters at the fixed 
points on. the body -emit- pulses that are received by a set 
. of -'microphones at the. .fixed reference points in the 
-environment-. The. tame.. of flight- from an emitter to a 
microphone is. proportional:: to an estimate of the distance 
between the emitter .and the microphone (i.e., the range) . 
The range estimates from the emitters to the respective 
• microphones are used to triangulate the. location of the 
emitters.- The locations of multiple emitters on the body 
are combined to estimate the orientation of the body. 

Other measurement modes, such as; optical tracking 
of light sources on a. body, can' also be .used to track 
motion of the. body. 
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- • - ■ • summary : 
In one aspect/ in general, the invention is a * 
method for tracking *a motion of a body which includes, 
obtaining two types of measurements associated with the 
motion of the body, "one of the types comprising acoustic: 
measurement, updating an- estimate of either an 
orientation or a position of the body based on one of the 
two types of ':rneastirement, -for 'example -based on inertial 
measurement , ahd updating the estimate based on .the . other 
of the tw6 types of measurements, for example based ,o.n 
acoustic ranging. * ■ ■ ? 

in 'another aspect,- in general^ the invention is a 
method for tracking the 1 motion of a body including . ~W 
selecting one of a set of reference devices , transmitting 
a control signal to the selected, reference device , -vf or 
example by transmitting a wireifess: control signal ,. .;- ;; 
receiving an range measurement- signal - from. the reference 
device, accepting a xange measurement related to:a..:.- 
distance to the' selected reference device, , and updating 1 "* a 
location estimate or an orientation '.estimatevof. .the. body.; 
us'xng the accepted range" measurement . / The: .method ;*.q an 
further in'clude determining a range measurement ' based on 
"a time of flight of the range measurement signal.-. ■;. 

• ' : Advantages - of the "invention include providing a 6- 
degree-of -freedom tracking -capability :that can function 
over an : essentially unlimited space in which an 
expandable constellation of ultrasonic beacons is 
installed.- Inertial measurements provide smooth and 
responsive sensing of motion while the ultrasonic 
measurements provide ongoing correction of errors,. , such 
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as those caused by drift of the inertial tracking 
component of the system... ; Small and. inexpensive inertial 
■■ sensors,- which often exhibit relatively large drift, can 
be used while still providing an overall system without 
5 unbounded drift. -Small, lightweight inertial sensors are 
. - well - .suited for head .mounted tracking for virtual or 
augmented : reality display systems. By. correcting drift 
using ultrasonic measurements., drift correction 
measurements which may be sensitive to external, factors 
10 such. as magnetic field variations, are not needed. The 
constellation of ultrasonic beacons can be easily 
expanded as -each beacon .functions independently and there 
is .no need, for wiring, airiong the beacons . The tracking 
device only relies on use. of. a small number .of ultrasonic 
15, .beacons at any time,, .thereby allowing the space in which 
; •.. the. tracking, device ..operates, to have irregular regions, 
such as multiple rooms in a building. 

Another advantage of . the . invention . is that by 
using an " inside -out " configuration, there is.no latency 
2 0 in. .acoustip. range measurements due t.o motion of the body 
1 after:; an.; acoustic:.; wave., is- emitted. ; 

Yet another advantage of the invention is that 
. tracking continues- using: inertial measurements even when 
acoustic measurements cannot be made, for example, due to 
2 5 occlusion of the beacons. Drift in the inertial tracking 
: - -is then corrected ..once acoustic measurements can once 
again be made . 

• In yet -another advantage, the invention provides 
line -of -sight redundancy whereby one or more paths 
30 between ..emitters and . sensors can be block while still 
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allowing tracking "of a body. 

Other 'features and advantages of the invention 
will be apparent 'from the following description, and -from 
the ' claims . 

' Description of the Drawings - 

Fig. 1 shows a tracking devibe and a constellation 
of. acoustic beacons used for trabking the device;- 

Fig.' 2 shows components of a tracking device 
processor; 

Fig.. 3 illustrates a combined inertial • and* 
acoustic tracking approach; • : 

Fig. 4 shows an' inertial measurement unit' (IMU) ; 

Fig. 5 shdWs an ultrasonic range measurement unit 
(URM) and an ultrasonic beacon; ' 

Fig. 6 shows an input/output interface used in a- 
tracking device processor to : interface with inertial and 
ultrasonic measurement units; - 

Fig. 7a illustrates- the- -navigation and body frames 
of reference'; *' 

Fig: 7b illustrates^ mutual- tracking devices;: - ' 

Fig. 8 is a signal" flow- diagram' of ? an- inertial 
tracker;' ' ' " " * ' • : J ' : ■ 

Fig. 9 is a signal fldw diagram of an ultrasonic 
range measurement" subsystem; • . * 

Fig', lb" is a signal flow diagram of a tracking 
device including an inertial tracker and Kalman predictor 
and updater elements; 

Fig. 11 is a signal flow diagram of a Kalman 
predictor; 

Fig. 12 is a signal flow diagram of a Kalman 
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- updater ■; ;-. , * 

\ .Fig - • 13 .is a flowchart of -a. tracking .procedure; 
- - Fig. 14a illustrates tracking of a second body- 
relative to a first tracked body; . . 
5 Fig.. 14b - illustrates mutual tracking of multiple 

• devices; * - 

: - -, . ; -Fig. 15- illustrates head mounted . display system; 
: Fig> 16 illustrates a. camera. tracking system for 
- television; and • - ..... 

10 . Fig. . 17 illustrates tracking of bodies in an 

■.. ■. automobile. - • - •'. I ; . ■ \ 

; ^ .-- Description t . . 

. Referring to Fig. 1-, .a. tracking device 10<D which 
maintains an estimate of its location and orientation is 
15 free to move .within, a large .room. For example, tracking 
' -device 100 can. be fixed to a head-up display (HUD) on an 
• .^operator's- head, and tracking device 100 moves through 
. the; room, and change s^ orientation, as the. operator moves 
and orients his. head;. Tracking, device. 100 includes a 

2 0 , processor; 1.3 0. coupled-; to an inert ial. measurement unit 

v ;(IMU) < 140. which prpyides- inert ial- measurements related to 
: linear; ■acceleration, and to- rates of rotation. Processor 
*: 130 . uses the inertia! measurements to . determine motion of 
tracking device 100 as it moves through the room. 
25. : » Processor . 13 0. is also coupled to an array of three 

.ultrasonic range measurement units (URM) .110 which are 
used to receive acoustic signals sent from an ultrasonic 
. beacon array 12.0, a ."constellation" of beacons.. 
Ultrasonic beacon . array 120 includes independent 

3 0 . ultrasonic beacons 122 in fixed locations in the 
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environment, for example, arranged on the ceiling -.of the 
large room-in a regular pattern 'such as on a -grid with 2 
foot spacing. Processor 130 uses the signals from 
particular ultrasonic beacons 122, as well as known 
three-dimensional locations of : those beacons, to estimate 
the range to those beacons and thereby sense motion for 
tracking device 100. Each ultrasonic beacon 122 sends an 
ultrasonic pulse 114 in response- to ■ infra-red command 
signal 112 sent from tracking device 100. In particular, 
each URM 110 on tracking device 100 broadcasts infra-red: . : 
(IR) signals to all of the ultrasonic beacons 1*22. These 
IR signals include address information so that only one 
beacon, or a "small number of beacons ,f recognize each IR* 
signal as ' intended for it, and responds to the signal . 
In response to an IR signal, an addressed* -beacon *■ ■ -a. 
immediately broadcasts "an ultrasbriic -^pulse thatus then- 
received 'by one or more URM 110 . As processor- 130 knows 
that ' the Addressed beiacon responded immediately 'tor- the PR 
command, it determines the time of -flight by measuring -r 
the delay from ' issuing the command -to detecting the 
ultrasonic pulse. The time oi' :: f light of, the ultrasonic 
pulse is used to estimate the range to the beacon; which 
is the'ri us£d to update the position and^ orientation' Of 
tracking' device 100. -* - : : :. 

Both the 'inertial measurements and the ultrasonic 
signal based measurements have -limitations . Relying on 
either mode of measurement individually is not as 
accurate as * combining the measurements . Tracking device 
100 combines measurements from both measurement modes and 
adjusts its estimate of position and orientation (i.e.,- 
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.. 6 degrees of freedom, 11 6-DOF" ) . to reflect measurements 
from both modes, as they are available, or after some 
delay. To do this ,. processor 130 hosts an implementation 
of . an extended Kalman filter, (EKF) that is used to 
5 combine .the measurements and maintain ongoing estimates 
of . location. and orientation of tracking device 100, as 
well as to maintain an estimate of the uncertainty in 
those estimates . .. 

Referring -to . Fig . 2, processor 13 0 includes a 
10 central . processing unit (CPU) 200, such as an Intel 80486 
microprocessor,- program storage 220., . such as read-only 
. memory (ROM) and ...working storage 230, such as dynamic 
random-- access, .memory (RAM). . CPU 200 is also coupled to 
an input /.output interface 210 which provide an interface 
15 to. IMU 140 and ; t.he URM 110. . Input/output interface 210 
: : includes digital -logic that provides digital interfaces 
to IMU, 14 0 and the URM, 110. . 

IMU . 140 provides, a serial data, stream 2 01 encoding 
inertial measurements. , Input/output interface 210 
2 0 converts, this serial data to a parallel form 212 for 

- . ..transfer to -CPU.-2p0^ . Each. URM. 110 accepts a serial 

signal .211 that is used to drive, an IR light emitting 
-diode 510 to broadcast the IR control ^ signals to 
ultrasonic beacons 122 (Fig. 1). Input/output interface 
25 210 accepts address information from CPU 200 identifying 
one or more ultrasonic beacons . and provides the serial 

- signal, to each of the URM 110 which then impose the 
serial signal- on an IR transmission (e.g., by amplitude 
modulation) . The. same serial signal is provided to all 

30 the URMs 110, which concurrently broadcast the same IR 
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signal. ' Each URM 110 provides in return a logical signal 
202 to input/output interface 210 indicating arrivals of 
ultrasonic pulses. Input /output J interface 210 includes 
timers that determine the time of flight of ultrasonic 
5 pulses from the beacons, "and thereby determines range 
estimates to the beacons. These range estimates are 
provided to CPU 200. 

An implementation of a tracking algorithm is ' 
stored " in " program storage 220 and executed by CPU 200 to 

10 convert the measurements obtained from input /output "' ; 
interface 210 into' position and orientation estimates . 
CPU 200 is also coupled to fixed data storage 240, which 
includes information such * as a predetermined map of the. - 
locations of the ultrasonic : beacons , and the locations of 

15 the microphones of the URM 110; Processor 130 also 

includes a commuhication interface 260 for coupling CPU * 
200 with other devices, such as a display device 280 that 
modifies its display based on : the position and 
orientation of tracking device 100 : . : v ; 

20 Operation: of the system can Be- understood 'by 

referring to Fig. .3, a two -dimensional view of --the" room 
shown in Fig. 1 (from above)' / : * The' sequence of open- 
circles arid arrows 310a-e represent the actual location 
and orientation of tracking "■ device 100 at each of a 

25 sequence of time steps*. Based on prior measurements, and 
oh inertial' measurements at the first time step/ filled 
circle and arrow 312a represent the estimate by tracking 
"device 100 of the location- and orientation of the 
tracking device at the first time step* At the next time 

30 step, tracking device 100 moves to position 310b, and 
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. based , on a new inert ial measurement , tracking device 100 
.updates, its position estimate to 312b. This is repeated 
for., the next .time step with actual position 310c and 
.'. .estimated position 312c.. 
5.- After . reaching position 310b, tracking device 100 

sends, an IR command addressed one of the ultrasonic 
transducers 122,, illustrated by dotted line 32 0. After 
receiving, the IR command (with essentially no delay) , 
ultrasonic transducer 122 transmits an ultrasonic pulse, 
10 . .illustrated, by wave 324.. Wave 324 reaches tracking- 
device 100 some time later, at actual location 330. 
Based on the time. of arrival ,. tracking device 100 
estimates, that. ..it was at position 332 when wave 326 
reached i.t ....... . 

15 At the next time, step, tracking device 100 first 

. . . estimates, its .position 3.12d based on an inertial 

..measurement . .Using, range information related to the 
;. ... ..^.separation .of .the .location of ultrasonic transducer 122 

........... and,.. location 332 .and a measured time of flight of the 

20. ultrasonic, wave, _ tracking, device 100 computes a refined 
position estimate, 312d' . . The process repeats using 
... . inertial measurements at true, position 310e and estimated 

position 312e. 

.In general, bpth^ an inertial measurement and an 
. 25 ultrasonic, measurement can be used at each time step, 
.... although ultrasonic measurement can. be made less 

. frequently. At each time step, both location and 

orientation, ..(attitude) is. updated. The ultrasonic pulses 
.caa provide information related to both location and 
30 - orientation through the use of multiple microphones that 
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are displaced relative to one another. 

Referring to Fig. 4," inertial* measurement unit (IMU) 
140 includes' three angular rate sensors (e . g .,; micro-machined 
vibrating rotation sensors or small" rotating gyroscopes) 420a-c, 
5 and three linear acceleration sensors 410'a-c. The sensors are 
arranged to lie along three orthogonal elxes that remain fixed in 
the frame of reference of tracking device 100.* Each 
acceleration sensor provides a "signal that is generally 
proportional to the acceleration along the corresponding axis, 
10 and each angular rate sensor provides a signal that is generally 
proportional to "the rate of rotation about- the corresponding 
axis . "* 

As" the' orientation of ihertial measurement- unit 140 
changes, the signals such as the acceleration signals correspond 
15 to changing directions in the fixed (navigation) reference frame 
of the room. Ineirtial measurement unit '140 also includes a 
signal interface 430 which accepts the "signals 4ll from each of 
the "six accelerometers and angular " rate sensors , and transmits a 
serial data stream 413 which multiplexes digital representations 
20 of the acceleration arid angular rate signals : " ' As is discussed 
further below, the acceleration " and angular v ratd "signals are 
imperfect, and may exhibit additive bias and* scaling 
inaccuracies. These scaling and bias inaccuracies may depend on 
the motion of the device. 
25 Referring to* Fig. 5; each ultrasonic measurement unit 

110 includes an inf ra-red light -emitting* diode (LED) 510 

that is driven" by IR signal generator 512 . Signal generator 512 
accepts serial signal 211 from input/output interface 210 (Fig. 
2) and drives IR* LED 510 to transmit that signal* to one or more 
3 0 ultrasonic beacon 122. The address of an ultrasonic beacon to 
which a range is desired is encoded in serial" signal* 211. Each 
ultrasonic beacon 122 includes an IR sensor 540 which, if there 
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. is a sufficiently short . unobstructed path between ultrasonic 
/ range, measurement-, unit ; 110 and that ultrasonic beacon, receives 
: the IR signal which, is .then, decoded by. IR signal decoder 542. 

This decoded. signal includes the address information transmitted 
.5 by the' ultrasonic range measurement, unit . Control circuitry 560 

receives the: decoded IR signal, and determines whether that 
' ultrasonic beacon . is ■ indeed, being addressed,. a>nd if so, signals 
'"•"a pulse generator 55-2 to provide a signal to an ultrasonic 

transducer 550 which generates an ultrasonic pulse. . The pulse 
-10 'passes through the. air.;to ultrasonic range ..measurement unit 110 
■• where* a" microphone 52.0 receives the- ultra-sonic pulse and passes 
■ ; a 'corresponding electrical, signal to a pulse detector 522 which 
produces a logical ..signal - indicating arrival of. the pulse. This 
pulse detection signal is : passed to input./ output interface 210 
15 (Fig. 2) . As discussed below, the time. of flight is not a 
' perfectly accurate" measurement of range. Error sources include 
timing "errors in detection of the pulse, acoustic propagation 
rate variations, .* for example, due to., air temperature , or air flow, 
- ■" "and* non- uniform in dif ferent directions . propagation of the 
2^0 ultrasonic wave from, the ultrasonic beacon. 
~~ ; Input /output ^interface 210 includes circuitry (i.e., a 

programmable* logic: array) -which implements logical components 
shown in Fig. 6. An IMU data buffer 630 accepts serially 
encoded acceleration and- angular rate data 413 from IMU 140, and 

2 5 provides the- six acceleration and rotation measurements 631 as 

output to CPU 2 00 . . Input/ out put interface 210 also includes a 
beacon address buffer 610. CPU 200 (Fig. 2) provides an address 
of the ultrasonic beacon to which a range should be measured. 
Beacon address buffer 610 stores the address . and provides that 

3 0 -address in serial form to each of the : URMs 110. At the same 

time that the address is transmitted by each of the URM 110 (and 
received by the ultrasonic beacons 122) , three counters 62 0a-c 
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are reset and begin' incrementing from -zero at a fixed clocking 
rate (e.g., 2 MHz). When -'each URM 110 detects the ultrasonic 
pulse from the beacon, the corresponding pulse detection signal 
is passed to the corresponding counter which stops counting. 
5 The counts are then available to- CPU 200 as the measurements of 
the time of flight of the ultrasonic pulse from the ultrasonic 
beacon to each URM 110. "Referring /to Figs. 7a-b, -tracking 

device 100 (Fig. 1) determines its location in the navigation 
reference frame* of the room, shown as axes 710, labeled N- 

10 (north) , E (e.a ; st) , and D (down) . Location r (n) 730 is -a- vector 
with components (r£°, r™ t r£V of -the displacement from axes .710 in 
the N, E, and D directions respectively. Tracking .device, 100 
also determines its attitude (orientation) . 

Referring to Fig. 7b, • attitude is represented * in^ terms 

15 of the roll, pitch, and yaw (Euler) ^angles, 0 = 0|v 6, 4>) r - * needed 
to align the body attitude, represented: by coordinate axe^' 72 0, 
with the navigation attitude : represented by coordinate-axes 71.0. 
The three Euler' angles are represented . as a 3x3 direction cosine 
matrix, C fc "(6) , which transforms a Vector, of coordinate? in the 

2 0. body frame of reference by essentially applying in sequence- yaw, 
pitch, and then roll motions around: the. vz , y, -and then x axes. 
The direction cosine- matrix- can be defined as 



C(6) = 



10 0 
0 coslJJ -sinijJ 
0 sin\|/ cost|j 



cosB 0 -sin6 

0 . • •- 1 - 0 
sin0 0 . cos6 



:cos(j> -sin(|x 0 
sin<J) cos(J> 0 
0 0 1 



The superscript and- subscript notation C" signifies that the 
25 matrix takes a vector in the '-'b" (body) reference frame. and 
provides a vector in the : "n" (navigation) reference frame. 

Referring to Fig. 8, inertial sensors 800, including 
rotation sensors 420a-c and acceleration sensors 410a-c, provide 
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: . inert iaX measurement signals to an inertial tracker 810. 

Inertial tracker 810 implements a discrete time approximation of 
the signal flow shown . in the Fig.; 8. Inertial tracker 810 
includes several stages. First, gyroscope compensation 820 

'5 modifies the" (vector) angular rate signal & to account for bias 
in the measurement,. Mn this example, only - an additive 
bias 6o> is corrected. .. Other ..biases such- as- a multiplicative 
error (e.g., an incorrect scale factor), and errors due to 
mounting inaccuracies can. be corrected as—well. . Accelerometer 
10 compensation" 83 0 similarly corrects : for ; an : additive bias ba (b) on 
:the.- acceleration signals - As is-, discussed f ully beloy, 

'- several parameters, including the bias terms. 6co ^nd 6g?° are 
estimated using ultrasonic measurements. 



15 based on the bias corrected- rotation signal . In this example, 
attitude integration is performed using a direction cosine 

• representation of the attitude. A, discrete time implementation 
of the continuous differential equation C/(r) = C b "(t) S((o{t)) -is used 
to update the direction cosine matrix at a fixed rate, typically 

20 between 100 and .200 per second. 'Changing notation to a discrete 
time system (e.g., C k = C b "(kAt) ), the discrete time update- of the 
direction cosine- matrix is. implemented as 



Attitude integration 84 0 updates the attitude estimate 



/ 



sin 68 
68 



1 -cos 68 
68 2 



:: : C k ■* C 



•where 



25 



68 = 




A/ , : 68 - 8MB 



and 



. 5(68) = 



0 -68, 68^ 
68 - 0 -68 

z x 

-68 68 0 

y x 
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is the skew symmetric matrix of -68 Note that S{6&) satisfies 

In-order to ensure that C k truly is a direction cosine matrix, 
its rows are orthonormali zed after each iteration to remove any 
5 numerical or approximation errors that may have entered, into its 
entries. • ; - - ; ' '\ * " Vi ~ 

- Based^ on : the tracked direction- cosine; .matrix; C k ' , 
coordinate transformation 850 accepts the bias . corrected : -. 
acceleration signal - in - the body reference frame ..and .-outputs an 
10 acceleration signal in the navigation reference .frame according 
to 1 ■ ■ ■ ' "^ ■ ■ • : \ ■: • 



Double integration 850- then computes the velocity /.and,. position 
according to •• - - \ - : 

-15 : - - v<"> = rf* +, k '\ > At , r. , : ; ■ - .. ■ 



Bind 



2a in) ' 
(i.) = («) * v (n) At + * A; 2 



Euler angle computation 870 takes the direction cosine matrix 
and outputs the corresponding Euler angles. The output of 
20 inertial tracker 810 is (6 , c in V • The state of the inertial 
tracker includes a 15 -dimensional vector composed on five sets 
of three-dimensional values 

* = (6 , (o , c (n) , v (n) . a {n V - 

As is discussed fully below, inertial tracker 810 
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receives error update . signals 6^ derived from ultrasonic range 
measurements that it uses to correct, the attitude, velocity, and 
position values, .and to updat ; e the parameters of the gyroscope 
and . accelerometer bias correction elements . 
5 . ... Referring to Fig. 9, a beacon sequencer 910 receives 

• ■ location estimates r (fl) . from inertial tracker 810. Using a beacon 
map- 915 of the locations (and .addresses) of the ultrasonic 
beacons 122 (shown in Fig. 1)., beacon sequencer 910 determines 
• ■■: . which beacon to trigger at- each time, step .in order to generate 
10 ultrasonic range measurements . . For instance, beacon sequencer 
9 l-0v determines the " closest beacons to the current location, and 
cycles among these beacons on each time step, As the location 
.estimate changes, the set of closest . beacons also, in general, 
: changes. After beacon sequencer 910 triggers each of the 
15 beacons in turn, the corresponding ultrasonic pulses arrive and 
■are detected by the tracking . device . Each pulse generates one 
• \ % , range measurement for ^each microphone used to detect the pulse. 
, In, this embodiment , each -pulse .generates a set of three range 

measurements, one. from each of the microphones in the three URM 
20.110 . ^ ... : , ■ . . . - . 

. ; • : : - .Referring, still to Fig. 9, range measurement 92 0 
corresponds to ■ the .process . of receiving an ultrasonic range 
estimate. The relevant parameters for a range measurement are 
- the location of the addressed beacon,. & {n) , the -location of the 

2 5 microphone used to detect the pulse, u£ b) * the range estimate 

itself, d r : , and the time- the pulse was detected, t r , which is 
v used to correct for latency in. the measurements. Note that if 
; the. location estimate had no error, and. the, range estimate was 

perfectly, accurate, - then the range estimate would satisfy 

3 0 d r = I! k [n) - (L {n \t r )+C b \t r )m} b >) || . 



BNSOOCID <WO 99&3838A1 1 > 



WO 99/53838 



PCT/US99/07831 



17 

Deviations "from this equality are used' to' correct the parameters 
and output's of inertial tracker 810. 

A complementary Kalman filter "is us : ed by tracking 
device 100 to improve' the tracked location- and orientation 
5 estimate by incrementally updating the tracked quantities as the 
range measurements come in. Referring 1 to Fig. 10, the approach 
involves two' related components . As inertial tracker- 810 
updates its output \x *, a Kalman predictor • 1010 maintains an 
estimated covariance matrix P of the error in x . For instance, 
10 in the absence of any drift compensation in ihertial tracker 
810, the; covariance matrix P would correspond to an ever- 
increasing error. 

The second component used-' in this approach is ; a Kalman 
updater 102 0 which accepts information from- range measurement 
15 920 and using this measurement information determines an ^ 
estimate of the accumulated error b& which it feeds" back to 
inertial tracker 810 where it is used to update i . Also, after 
each ultrasonic measurement, Kalman updater 1020 computes a new 
estimated ' covariance matrix />(+) of the "error in £ after the 
20 update, which it feeds back to Kalman predictor 1010. Each 

ultrasonic measurement partially corrects the output of inertial 
tracker 810. " A continuous" series of 'ultrasonic .updates ensures 
that the error remains smalli ' ; • - • r ' 

' inertial tracker 810 is a 'nonlinear processor' of its 

2 5 inputs, and therefore,* a formulation of "a Kalman filter for- a 
purely linear filter driven by Gaussian noise is not 
appropriate . Using what is generally known as an "extended 
Kalman filter" (EKF) , a linearized % dynamical system model which 
characterizes the ' propagation of error in ' the * output ^' of 
30 inertial tracker 810 is used. The error that the EKF models is 

6* = . bi£l , 6r (n> , 6v (fl) , 
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with the components corresponding to. the .components of the 
vector output of the inertial tracker. Note that the error 
term ba ib) is modeled in the body coordinate system rather than in 
the navigation coordinate system,, and that the other elements 
5 correspond directly to errors in the output of inertial tracker 
810., - The parameters of . the. linearized error propagation model 
include a state transition matrix, and a covariance matrix of a 
driving noise which is assumed to drive this error model. Both 
tfie state transition matrix and the driving noise covariance 
10 depend on the output of inertial tracker. In the absence of any 
measurements, the mean of the error process jremains zero. 
However, the covariance of the error grows. The linearized 
model of error propagation is 



6x 



= F (x ) 6x + w 



15 The entries of F k = F(z k ) are derived . from a perturbation analysis 
of the update equations used in inertial tracker 810, and 
correspond to. the following error propagation, equations: 



A d) - C h " So 



k-l 



6o> = 6o) . 
t • k- 



6v t . = tx k +-At ~ A ' S(^ t i )(a ( ^ +(0,0, -gf) , and 

: The covariance Q k of . the process noise vv r is assumed to be 
25 diagonal. The entries of this covariance matrix are derived 
from known sources of error in the inertial measurements 
provided to inertial tracker 810, including additive bias . 
errors >• scaling errors, alignment errors of . the sensors. with the 
body axes, and. signal- noise from the. sensors themselves. The 
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individual variances ' depend on the output of the inertia! ; 
tracker as ' follows : 

Q k = diag( 0^,0^,0^^ ) 

where the individual variance terms are -parameterized as 
5 follows : ' 

= GyroScale <x> x At + : Gyro Align (co;+G> 7 ) At + GyroNoise y[Kt f 

1 o. = GyroScale G> At +' GyroAlign (ok+g^) Af + GyroNoise ' \/Ar : 
. . % y . J — - 

o^ = GyroScale g> z Af + GyroAlign- (0)^+0)^) Af + GyroNoise y/At\ 

°o) = GyroBiasChangeRate A/ 

10 o=o=o=0 r 

O v = AccelScale a x At + AccelAlign (a^+a,) At + AccelNoise \/Af 

o = AccelScale a At + AccelAlign (o^+a^) Af + AccelNoise «[At 
v y y * , — 

o v = AccelScale a z At + AccelAlign C^+op Ar + AccelNoise yJAt 

o\ = AccelBiasChangeRate Ar 7 

15 where GyroScale, AccelScale, GyroAlign, and AccelAlign 

correspond to degree of uncertainty in calibration coefficients 
used for instrument error compensation . .In general, a non- 
diagonal process noise covariance can be used. - 

'" Referring to Fig. 11, Kalman* predictor 1010 has two 

2 0 stages. An error linearization stage 1110 first 

computes F k and Q k as outlined above. Then, a covariance 
propagation stage 112 0 iteratively updates the error covariance 
by applying' a Kalman filter covariance propagation 'equation 

2 5 on each time step. When Kalman predictor 1010 receives an 
updated covariance />(+), which is ' produced* as a result of an 
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ultrasonic. range measurement, that updated covariance replaces 

the current error covariance P . 

Referring to. Fig . 12, Kalman updater 1020 accepts the 

output of range measurement 920, as well as the estimate of 
5 location and orientation, from inertial, tracker 810, and the 

covariance of the .error of the estimate . of location and 

orientation from Kalman . predictor 1010, and computes an error 
.7 estimate, and an updated covariance that results from applying 

the error, estimate. A first stage, of Kalman updater 1020 is 
10 measurement residual computation 1210.. The difference between 

the expected range and the measured range is computed as 

bd r = d r - || k {n) - (r (w) (( r )+C;(g2L (fc) ) II , .. ; 

Note that in general a range measurement is used some time after 
it was initially detected. In order to account for this 

15 latency/- estimates of the, location and orientation of the 

tracking device at the time that the acoustic pulse arrived are 
s . used, rather; than the,, location and orientation at the time that 
the measurement is used. The. current location, orientation, and 
linear land angular rate estimates are used to extrapolate back 

2 0 to; the ^measurement , time , r to determine c {n K0 and C b( f } - 

In order to apply the Kalman update equations, this 
residual- is modeled using a linearized observation equation as 

. ... bd r = /ffe,^ r ,£?L) & + v • . 

- - The observation matrix H k = H^^d^nO is the linear effect of 
2 5 errors in location and orientation on the error in range 

measurement.. The additive noise v has. a variance R(& k >b,d r9 n0 • 
H k has -the form- 
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b D m E -b E m D +r B m N -r D m E b ^ ~b D m +r D m -r^ D b £ m „ -b^m^r^m^ -r^ „ 

Hk " ( 7, -—J, *, 

o;o,o;^ w ^ fc ^^^;^^.o > o.o > o > 6.o) 

. . . . d r d r d, . . 

The variance R(x. k ,b_,d r ,sO is " derived to model various phenomena 
associated with ultrasonic range measurement. For example, as 
5 the range ' increases, pulse' detection is more difficult/ due in 
part to pulse spreading, and an increased variance is used to 
model the associated range measurement error. The 
variance R(x ,b,d.m) has the form - ■ 

k r 

R = o\ + a) 

10 and is parameterized as 

= NoiseFloor * + NoiseScale d-. f 

and 1 

o) = (kAt-t r ) H k (o) x ,^,(o 2 ,o,o;o,v x ,v > ,v r ,o,o,o,o,o,o)) r 

The first two terms of H k can ^alternatively be - set to 
15 zero to allow accelerometric tilt correction (if- it is mbrel, 
accurate). It the third " term is set to zero,' yaw drift 
correction will occur over a longer "time period but -to higher 
accuracy . ' ' x ' - " 1 

Kalman updater 1020 includes a- measurement ■'- 
20 accept/reject stage 1230. Accept /re j ect stage 1230 takes the 

measurement residual, 6^ , and the computed variance, R , of the 
measurement residual. If the measurement residual is greater in 
magnitude than a predetermined multiple of the computed standard 
deviation of the measurement residual > then ' the measurement is 
25 rejected as being suspect/ for example, due to premature ■ or late 
triggering of an ultrasonic pulse detector. Otherwise the 
measurement residual is further processed to compute the state 
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error estimate, . Using Kalman filter update equations, 
Kalman gain computation; 124 0 computes the Kalman gain as 

- . K = P±H*[H k P k H? + * . 

Error estimator 1250 then computes the error estimate 
... .5 as. 6x = K bd ,- and covariance updater 1.260. computes the updated 
-.•.•error covariance as ■ / 

; . =(I - KH)P k . . 

The components of &x are then used to update inert ial tracker 
..810.. .The computed, terms 6o) and ,6a (6) are passed to gyroscope bias 
10 correction 820 and apcelerometer .bias correction 830 (Fig. 8), 
respectively, where; -they are added to the current stored bias 
* . parameters . The computed, term? . 6v (n) and. are passed to double 

integration 860 (Fi.g.~ 8) where - they . are addecj to the current 
estimates of aijd 't (fl) , ;, ' respectively. Finally, t^he. direction 
15 cosine matrix ;is. updated .according to . 

:■ ::: , L ' - ;/ : . G k -.(j-S(&) C k 



. and re- or thonormali zed. ...... 

• Referring back to. Fig. 1, ultrasonic beacon array 120 
includes individual ' ultrasonic beacons .122 arranged in ; a regular 
. -20 pattern.. For; example; the beacons -may be, arranged on a square 
grid with a spacing of approximately 2 feet,, preferably with an 
■•■ accuracy- of : 3mm or less. A limited number of addresses are 
available- for the beacons, in this embodiment only eight 
different addresses are available -due to hardware limitations. 
25 Therefore, when the; tracking device sends an IR command to an 
address, in general ,. multiple ultrasonic beacons will receive 
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the signal and respond. Only th£ closest beacon with any 
particular address is used- for range measurement . However, as 
multiple beacons may be responding to each IR command, the pulse 
detection circuit may be triggered prematurely , for example, by 
5 a pulse from a beacon triggered in a previous iteration, but 
that is sufficiently far away that its pulse does not arrive 
until after a subsequent' iteration. In order to avoid this pre- 
triggering problem, pulse detector 522 (Fig. 5) is only enabled 
during a time window about the expect time the desired pulse 

10 would arrive. This avoids false triggering by pulses from other 
beacons, or signals resulting from long time constant 
reverberation of previous pulses'. 

In the description the : tracking' and Kalman updating 
procedures, an initial location and orientation estimate is 

15 assumed to be known: This is not necessarily the case and an 
automatic acquisition algorithm 'is used by tracking device 100. 
The limited number of addresses "of ultrasonic beacons . is used as 
the basis for* an initial acquisition ' algorithm; Initially, the 
tracking device triggers beacons ; with each of the allowable . 

2 0 addresses and measures the range to the closest beacon of each 

address. Then, the addresses of the four closest beacons are 
determined from the range measurements. The tracking unit 
includes a beacon map that includes the - locations: and. addresses 
of all the beacons. The beacons are arranged such that the 
2'5 addresses- of ' the f our closest' beacons^ limit the possible : 

locations to a small portion of the room, If there, is ambiguity 
based on the closest beacons,- the actual distances to the* 
beacons are used in a triangulation procedure to resolve the 
ambiguity. The' initial orientation is based on the relative 

3 0 range measurements to each of the microphones. . :.: 

The overall tracking procedure- can be summarized by the 
flowchart shown in Fig. 13. First; the initial' location and 
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orientation .is acquired- (step 1310) using, the approach outlined 
above The procedure, then enters a loop that is executed once 
..each- time step,. After waiting for the next time, step (step 

1320) , ; inertial measurements, are received (step 1330) and the 
5 tracked variables,, x , and the error covariance, P , are updated 
using the inertial measurements (step 1340) If an ultrasonic 
range measurement that has. not yet been processed is available 
(step 1350);, that -range measurement is used to compute an error 
update:, .. £x , and updated error covariance., P(+) , .(step 1360). 
; 10 . The error, update, and : new error covariance . are then used to 
... . update the -inertial tracker and the Kalman predictor (step 

13~7-0) . The procedure then involves determining whether further 
. range measurements must , be -commanded at thi.s time step (step 
1380).. As three, range measurements are made, for each pulse but 
15 only one- range measurement - is used, per time step, there may be a 
... . backlog of. range .measurements that will be applied in the 

upcoming time steps.: Therefore,, a new... range, measurement may not 
be necessarily for several future time steps. Taking into 
account the expected time of flight- of the next ..ultrasonic pulse 

2 0 (which, iii. general, is- more than a single time step) , the 

• procedure determines . if an. IR command should be sent to a beacon 
at this - time step . .(step. .1380) , the next beacon address is 
selected (step 1390) and, . if so, the IR command to that beacon 

• is sent (step 1395) . The procedure then loops again, starting at 
25 step 1320 waiting; for the start of the next time interval. 

.. . Several alternative approaches can also be used. In 

.the- described embodiment, only one range measurement is used per 
time step.. Alternatively, all available range measurements can 
b € . used at each .time step if the processor 130 has sufficient 

3 0 computation capacity. This alternative approach is implemented 

by looping from step 1370 back to step 1350 until all the range 
measurements are accounted for. Alternatively, rather than 
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applying' the Kalman updates for* each- of the scalar range ' 
measurements in turn/ all" can be applied' in a single step using 
similar update equations for vector observations and correlated 
observation noise. Also, rather than deferring processing of a 
5 range measurement until the next time step, the range . 
measurements can be incorporated as they arrive, and not- 
synchronized with the inertial tracker updates. 

The procedure described above can be combined with 
other measurement modes. For example,- inclinometers can. be used 
10 to provide measurements to the extended Kalman . filter that allow 
correction of attitude •drift'. Also, rather- than using three or 
more microphones which "allow -correction of all three degrees of 
rotation, two microphones can be used for range measurement in 
combination with a measurement mode "such as inclinometers'.^ In 
15 this way, some drift correction can -be based on inclinometers, 
but a compass, which is sensitive to magnetic field variations, 
is not needed for drift correction. Many more than .three 
microphones can also- be used to 'provide greater redundancy-and 
" allow more rotation freedom; •* - : 

2 0 As an alternative to mounting beacons in fixed %s 

locations in the environment, and microphones on*. the. tracking 
device*, which is often ref erred- to as an ■ "inside -out", i 
arrangement, this could be reversed- in> . an "outside -in*.; ,<::■ 
arrangement. The tracking device then, provides the .ultrasonic 
25 pulses and a coordinated array of- microphones senses the - 

location of " the * tracking device. Note that by .the time a pulse 
has reached a microphone, the tracking device" will have,, in 
general, moved oh to a new location. This latency, of - 
measurements must be compensated for in a manner similar:; to the 
30 compensation of latency in use of range measurements described 
above . ■ ■ • 

Beacons 122 need not be-. mounted in a planar array. 
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-..They could be mounted on walls, as well as on the ceiling, or on 

other supports in the environment . For example, the beacons can 
■ be -mounted on light fixtures. : The number of beacons can be 
■ ^ -chosen to match the user 1 s requirements, and. the locations of 
5 the beacons can be chosen based on a variety of criterea, such 
■* as: availability of suitable mounting points and geometric 
considerations, and the beacon. map can be set to match the 

- Chosen' number and locations of the beacons,.. The number of 
beacons in the constellation can be increase.; or reduced by the 

: 10 user, so -long as the beacon map remains up to. date. 

.\ ; The • command signals from the tracking device to., the 

beacons can be sent using other -modes, than IR transmission. For 
example, RF, visible, or acoustic signals can be us,ed. .. The 
tracking device can also be wired to the beacons. 
15 .j Two or more objects can be. tracked in a.n "inside- 

but side- in" arrangement .. .Referring to Fig. 14a, tracking device 

100 tracks its -location as before. A . second tracking device 

T4 0 0 -includes three • addressable ultrasonic beacons. 1410 arranged 

- in -a known relationship jto-. one another. By triggering beacons 
26 :14:io --to /transmit . acoustic pulses that are received at the URM 

lld'ori tracking. device/ 100,- tracking device can. determine the 
relative location and orientation of the second, tracking^ device . 
'A^ : further extension,/ ^which provides increased accuracy in the , 
relative " location and- orientation estimates involves having a 
• '2 5-second i'nertial measurement unit fixed to tracking, device 1400, 
: ' .'and transmitting its inertial measurements to. tracking device 
100. If only a single beacon is placed on the second object, 
the relative, location can be sensed .using ultrasonic range 
" measurements,, without necessarily tracking the relative 
30 orientation of the second device. 

Referring to Fig. 14b, a "mutual tracking network" made 
up- -of multiple tracking, devices can be used. These tracking 
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devices track their individual locations with respect to the 
locations of thfe other devices in the environment v including 
fixed beacons and other moving tracked objects. This can be 
done with an addition communication system coupling the .tracking 
5 devices, such as an RF" local area network. . >. r ■ 

In" the above - described embodiments,: the ."map"- of... the 
beacon array is' assumed to be accurate. -As the range 
measurements include" redundant information, errors in placement 
of the beacons' 'can : be iteratively estimated and updated, thereby 
10 improving accuracy. "Specifically, the placement errors, of the 
beacons can be included in the state of the extended Kalman 
"filter, and' range measurements from. each, beacon, would then 
' contribute over time to estimating- the placement errors . . . .. A 
separate initial automatic "mapping" -mode can also be. used^in 
15 which, through range : measurement from-- one or more locations ;in 
the robm and' triangulatioh "calculatdons : ^ the locations of * the 
beacons can be determined. These automatically determined 
locations can be used as the knowii "locations , or as initial 
" i ; estimates' -that are then further updated .using the Kalman filter. 
' ' 20 In this type of approach, the : beacons- can be - irregularly placed 
Within the room without requiring that they :be precisely ..; 
positioned. ' : - : - '"•-- ^ ;. • 

r ' The tracking approach described, above ha&. several 
' "^applications. A first application involves coupling • the 

25 tracking device to a head mounted display ." Referring - to- Fig . 
15/ a head mounted display 1510, allows a. user to directly view 
" a physical object 1520, such as a work piece.. Display 1510, 
using the known location of work piece 1520. in- the. frame of 
reference of the room, superimposes information on- .the user's 
30 view of the work piece. For example , . applying wiring harnesses 
to' a large device, the superimposed information can include 
information related to the correct placement, of the wiring 
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harnesses. A similar head . mounted display can also be used to 
..provide the complete image viewed by a user in a virtual reality 
system, rather than superimposing an image on the real view seen 

- by the user. 

.5-, s . Another application involves tracking a camera location 

in a television application. Referring to Fig. 16, a common 
technique- in television . production is to film a subject 1620 in 
front of .a, blank (typically monochrome) background and then to 
electronically superimpose another image (illustrated as 1630) 

--10, as a background. A difficulty with .such a technique is that as 
camera 1610 moves,, /the. background image should change to reflect 

- the camera's motion. .By attaching tracking device 100 to camera 
•1610, the. location and . orientation of the camera is tracked and 

v the background image, can.be automatically modified by an image 
15 processor that receives the changing position and orientation of 
the camera. This .approach allows construction of large "virtual 
sets" which is stored in the image processor, and thereby 
-multiple and changing camera "angles" can be used. 

-.-r Ano t he r : application involves sensing of motion of 
2 0 elements in an automobile, for example,, in an automotive crash 
test. Referring to Fig. 17, the motion of a dummy 1720 within a 
crashing ; automobile -1710 can be tracked using tracking device 
.100. In addition, a sepond obj ect , such as a point on the 
firewall- can be tracked using an addition beacon 1730 using the 
■; 25 inside-outside-in approach described above. This allows both 
. -.tracking of the dummy, in the . reference frame of the automobile, 
•and tracking of a point within the vehicle relative to the 
dummy. 

.Other applications include robotic navigation, tracking 
.30 of inventory, assets, or personnel, shipboard virtual or 
• ; augmented reality for damage control, film camera tracking, 

entertainment (e.g., theme parks and games), full body tracking 
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for motion capture, ' and weapon tracking. 

Alternative embodiments "can also use other approaches 
to inertial tracking. * For example, -rather than performing 
attitude integration using a direction cosine matrix, • attitude 
5 integration using Euler angles or quaternions can equivalently 
be used. Note' that the linearized error propagation - system 
matrix and driving noise covariance 'may depend somewhat- on the 
particular tracking algorithm used'. Also, the state of the 
Kalman filter can £>e changed; for instance, to include other 
10 terms. One example of this is to not only track accelerometer 
additive b r ias, as in the embodiments described above, but-also 
to track multiplicative bias '(e.g.'/ error in scale factory of 
the accelerometer signal, misalignment, and the speed of sound . 

Other methods of rahge measurement can also be used, 
15 including ' acoustic phase, RF or optical" time of f light ;- RF*"or 
optical phase, and mechanical cable extension. - : * -~ 

Other methods of fusing inertial and acoustic " " - 
measurements can be used instead v of Kalman - filtering . -For * 
example, neural network, rule-based • reasoning , or fuzzy logic 
" 20 systems, or optimization methods," can be used to combine the 
measurements . ■.. - « i ....... • 

In the description above, -only eight -different 
ultrasonic beacon addresses are us^d. Alternatively, -each 
' ""beacon can be individually addressable , or : a larger -number of 
2 5 shared addresses can be used. If the beacons are individually 
addressable, initial acquisition can' be performed, for example, 
by having beacons also respond to "group* addresses, or to 
sequence commands addressed to individual beacons during : the 
acquisition phase in such a "way that tracking device can "zero 
30 in" to it's ihitial location by first finding one beacon that is 
in range, and then search for additional beacons that 'are closer 
and closer based on the beacon map known to the tracking device. 
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Such an approach can also be used, when the tracking area is made 

up of several different rooms. Initially, the room that the 

tracking device is determined and then, the location within the 

room can be found. : . . . 

5 It is to be understood that the foregoing description 

.-, is. intended, to illustrate and not limit the scope of the 

invention; which is defined by. the. scope of the appended claims. 

Other aspects, advantages, and modifications are within the 

scope of the following claims... 

10 What is claimed is: 
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1 . "A method for tracking a motion of a body 
comprising: 

obtaining two types of measurement s : associated with the 
motion of the body, one of the types comprising acoustic 
5 measurement ; 

updating an estimate of either an orientation or a 
position of the body based 7 on one of the 'two types "of 
measurement ; and ' f: 

updating the estimate'- based' on the- other of the two 
10 types of measurements. 

2 . The method of claim 1 in which one of the types of 
measurement comprises acoustic ranging. 

3 . The method of claim 1 in which the other of. the 
types of measurement comprises inertial measurement. 

15 4. The method of claim 1 in which the estimate is of 

orientation. 

5 . An apparatus for tracking motion of a body 
comprising: 

two sensor systems configured respectively to obtain 
2 0 two types of measurements associated with motion of the body, 
one of the types comprising acoustic measurement; and 

a processor coupled to the two sensor systems and 
configured to update an estimate of wither an orientation or a 
position of the body based on one of the two types of 
2 5 measurement , and to update the estimate based on the other of 
the two types of measurement . 

6. A tracking device comprising: 
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a sensor system including 
■ • 1 ■ ■ an inert ial sensor; . and 

a set of one or more acoustic sensors rigidly 
coupled tb" the ' inertial senior; and 
5 : ' - a processor programmed to perform the functions of 

-*' accepting inertial measurements from the inertial 

sensor ; 

* : updating a location estimate and an orientation 

estimate of the sensor system using the accepted inertial 
10' measurements ; 

'- - • : * selecting one of" a plurality. of acoustic reference 

devices ; 

• accepting an- acoustic range measurement related to 
the distance between the sensor system and the selected .acoustic 
15 reference device ; - - 

updating the location estimate and the orientation 
estimate using" the accepted range measurement. . 

7. The tracking device of claim 6 wherein the sensor 
system ' includes' a transmitter for transmitting a control signal 
2 0 enbodihg 'an identifier of the selected acoustic reference 
device, and each acoustic sensor includes a microphone for 
receiving an acoustic signal from the acoustic reference device. 

8 . • The tracking device, of claim 6 wherein the set of 
one or more acoustic sensors includes two or more acoustic 
25 sensors . ' - . ' 

9. The tracking device of claim 6 wherein 
' ' updating a location estimate and an orientation 

estimate using the accepted inertial. measurements includes 
updating an uncertainty in the location and the orientation 
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estimates; and 

updating the location estimate and the orientation 
' estimate using the accepted range -measurement includes 

determining an uncertainty in the range measurement, and 
5 updating the uncertainty in the location and the orientation 

estimates using the uncertainty in the range measurement. 

■ . ... io.. • A method for tracking the motion of a body 

including: . - : *: . ; 

selecting one of a plurality of reference devices; 
10 transmitting a control- signal .to the selected reference- 

device; : 
receiving an . range measurement signal from the 

reference device; 4 

accepting a range measurement related to a distance to 
15 the selected reference device; and - _ • M'' 

updating a location estimate- or an orientation estimate 
of the body using the accepted range measurement. 

11. The^methodof claim >0 ; ^further comprising :, 

. determining a. range measurement based on. a . time of 
20 flight of -the range measurement signal-. : _ 

12. The method of claim 10 wherein transmitting the 
control signal -includes transmitting- a wireless control signal. 

13 . Software stored on a computer readable medium 
comprising instructions for causing a computer to perform the 

25 functions of: - * 

. selecting, one of .. a plurality of reference devices; 
transmitting a control signal to the selected reference 

device; 
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receiving an range measurement signal from the 
reference device; 

accepting a range measurement related to a distance to 
the selected reference device; and 
5 updating a location estimate or an orientation estimate 

of the body using the accepted range measurement, 

14. A tracking system comprising: 

an acoustic reference system including a plurality of 
acoustic reference devices; and 

10 . t a tracking -device including 

. a sensor system including an" inertial sensor and a 
set of one or more acoustic sensors rigidly coupled to the 
inertial sensor, and . 

a processor programmed to perform the functions of 

15 accepting inertial measurements from- the inertial sensor, 

updating a location estimate arid an orientation estimate of the 
sensor system using ..the accepted inertial measurements, 
selecting one of a plurality of acoustic reference devices, 
accepting an acoustic range measurement related to the distance 

;2 0 between the sensor , system and the selected acoustic reference 
device, and updating " the location estimate and the orientation 
estimate using the accepted range measurement. 

m • • - 15. The -system of- claim 14 wherein the sensor system 

includes a transmitter for transmitting a control signal 

25 encoding an identifier of the selected acoustic reference 
device, and each acoustic sensor includes a microphone for 
receiving an acoustic signal from the acoustic reference device, 
and wherein each acoustic reference device includes a receiver 
for receivng the control signal from the sensor system, and an 

3 0 acoustic transducer for sending the acoustic signal. 
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